Micro-Expression Recognition Base on Optical Flow Features and Improved MobileNetV2

نویسندگان

چکیده

When a person tries to conceal emotions, real emotions will manifest themselves in the form of micro-expressions. Research on facial micro-expression recognition is still extremely challenging field pattern recognition. This because it difficult implement best feature extraction method cope with micro-expressions small changes and short duration. Most methods are based hand-crafted features extract subtle movements. In this study, we introduce that incorporates optical flow deep learning. First, take out onset frame apex from each video sequence. Then, motion between these two frames extracted using method. Finally, inputted into an improved MobileNetV2 model, where SVM applied classify expressions. order evaluate effectiveness method, conduct experiments public spontaneous database CASME II. Under condition applying leave-one-subject-out cross-validation accuracy rate reaches 53.01%, F-score 0.5231. The results show proposed can significantly improve performance.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Facial expression recognition based on geometric and optical flow features in colour image sequences

Facial expression recognition is a useful feature in modern human computer interaction (HCI). In order to build efficient and reliable recognition systems, face detection, feature extraction and classification have to be robustly realised. Addressing the latter two issues, this work proposes a new method based on geometric and transient optical flow features and illustrates their comparison and...

متن کامل

Preprocessing and Descriptor Features for Facial Micro-Expression Recognition

Facial micro-expressions contain signi cant information about how people feel, even when they are attempting to conceal their emotions. Previously, very little research has been done to detect and recognize micro-expressions using computer vision methods. In this paper, detection and classi cation of microexpressions from the Spontaneous Micro-Expression database were implemented, following pre...

متن کامل

Improved Performance in Facial Expression Recognition Using 32 Geometric Features

Automatic facial expression recognition is one of the most interesting problem as it impacts on important applications in humancomputer interaction area. Many applications in this field require realtime performance but not all the approach are suitable to satisfy this requirement. Geometrical features are usually the most light in terms of computational load but sometimes they exploits a huge n...

متن کامل

Subtle Expression Recognition Using Optical Strain Weighted Features

Optical strain characterizes the relative amount of displacement by a moving object within a time interval. Its ability to compute any small muscular movements on faces can be advantageous to subtle expression research. This paper proposes a novel optical strain weighted feature extraction scheme for subtle facial micro-expression recognition. Motion information is derived from optical strain m...

متن کامل

Differential optical flow applied to automatic facial expression recognition

This work compares systematically two optical flow-based facial expression recognition methods. The first one is featural and selects a reduced set of highly discriminant facial points while the second one is holistic and uses much more points that are uniformly distributed on the central face region. Both approaches are referred as feature point tracking and holistic face dense flow tracking, ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Ksii Transactions on Internet and Information Systems

سال: 2021

ISSN: ['1976-7277', '2288-1468']

DOI: https://doi.org/10.3837/tiis.2021.06.002